1 

How to Understand LMMSE Transceiver 



Design for MIMO Systems From Quadratic 

Matrix Programming 

Chengwen Xing*, Shuo Li, Zesong Fei, and Jingming Kuang 



Abstract 

In this paper, a unified linear minimum mean-square-error (LMMSE) transceiver design framework 
is investigated, which is suitable for a wide range of wireless systems. The unified design is based on an 
elegant and powerful mathematical programming technology termed as quadratic matrix programming 
(QMP). Based on QMP it can be observed that for different wireless systems, there are certain common 
characteristics which can be exploited to design LMMSE transceivers e.g., the quadratic forms. It is also 
discovered that evolving from a point-to-point MIMO system to various advanced wireless systems such 
as multi-cell coordinated systems, multi-user MIMO systems, MIMO cognitive radio systems, amplify- 
and-forward MIMO relaying systems and so on, the quadratic nature is always kept and the LMMSE 
transceiver designs can always be carried out via iteratively solving a number of QMP problems. A 
comprehensive framework on how to solve QMP problems is also given. The work presented in this 
paper is likely to be the first shot for the transceiver design for the future ever-changing wireless systems. 
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I. Introduction 

In order to satisfy the ever-increasing wireless data rate requirements and to enable high 
quality and highly diversified wireless services, wireless research never stops to search new 
discoveries and development in ideas, technologies, systems and everything available. More and 
more available wireless resources are introduced into wireless systems. The scope of wireless 
designs has been extended to be multi-dimensional such as temporal, frequency, spatial even 
coding. As a gift the multi-dimensional wireless resources bring new challenges into wireless 
system designs. To order to realize the promised performance gains coming from these resources, 
some corresponding new technologies need to be adopted, such as multiple-carrier technology, 
multiple- antenna technology and so on. 

Referring to the spatial resource, multiple-input multiple-output (MIMO) technology is a great 
success in both theoretical research and industrial productions [HI. Along with the evolvement of 
wireless systems, MIMO becomes to be a fundamental and important ingredient of complicated 
wireless systems e.g., cooperative communications, cognitive communications, physical layer 
security communications, network coding based communications and so on. Although MIMO 
technology has promised great potentials in diversity and multiplexing gains, a complicated 
transmit/receive beamforming or transceiver design is usually needed BH. Different from the 
simple single antenna case, for MIMO transmissions the resources should be carefully allocated 
across spatial domain according to available channel state information (CSI) at transmitter or 
receiver or both [|3]. 

For MIMO transceiver designs, there are various performance metrics such as capacity, bit error 
rate (BER), mean- square-error (MSE) and so on. Different performances represent the different 
preferences of the wireless designers. Meanwhile, because of a variety of wireless service 
requirements and wireless environments, different wireless systems have totally different network 
architectures and wireless interfaces. In the resulting transceiver designs, all of these facts are 
reflected on the constraints and the variables involved in the considered optimization problems. 
In other words, for different wireless systems the transceiver design problems have different 
signal models, different power constraints, different numbers of variables and even different 
performance criteria. As a result transceiver designs must be investigated case by case. From the 
theoretical research perspective, the theorists and researchers would like to find a unified design 
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which can reveal some common nature of the transceiver designs. To the best our knowledge, 
up to date the transceiver designs have not been unified for both different performance metrics 
and different systems. Although the transceiver designs with different performance metrics for 
different systems are totally different, the work on unifying transceiver designs never stops. 

In the existing work for unified linear MIMO transceiver designs, the widely used logic is for 
a given wireless system linear transceiver designs with different performance metrics are unified 
into one kind of optimization problem [|3l, [|4l. It is well-known that there are two guidelines for 
linear MIMO transceiver designs, i.e., using majorization theory [3] and weighting operation [31. 
For the majorization theory based guideline, the transceiver design logic is to formulate different 
performance metrics as different functions of the diagonal elements of the data detection MSB 
matrix at the destination. Then the objective functions are classified into Schur-convex or Schur- 
concave functions. Relying on the fundamental properties of Schur-convex/concave functions, the 
optimal solutions can be derived. On the other hand, using weighting operations, the different 
performance metrics are optimized by solving a weighted MSB minimization problem with 
different weighting matrices. 

In this paper, in contrast to the existing work we give a unified transceiver design which aims 
at unifying the linear transceiver designs for different wireless systems with the same perfor- 
mance metric named as minimum mean-square-error (MMSB). It can be revealed that for the 
beamforming designs in different wireless systems such as multi-cell coordinated beamforming 
design, multi-user MIMO beamforming design, cognitive MIMO beamforming design, amplify- 
and-forward MIMO relaying beamforming design and their corresponding robust transceiver 
designs with randomly distributed channel estimation errors and so on, the transceiver design 
problems can always be solved by iteratively solving a series of matrix quadratic programming 
(QMP) problems that can be efficiently solved. 

It is true that our work focuses on iterative linear minimum mean-square-error (LMMSB) 
transceiver designs which may not be the optimal strategy. This kind of transceiver design 
suffers from some well-know weaknesses coming from the MMSB objective or iterative design 
procedure itself or both. We want to highlight that iterative LMMSB designs still have several 
attractive properties to make them much powerful in engineering applications, as they can 
be applied to a wide range of fields. Furthermore, they can give a solution with satisfactory 
performance and they can also act as a benchmark for other kinds of suboptimal schemes. 
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Wireless systems change very fast e.g., from a point-to-point system to cognitive radio net- 
works or cooperative networks. Although we can describe some about what the future wireless 
systems is like to be, unfortunately we never know what they are exactly. However, the authors 
believe that there is definitely something that will not change. Quadratic forms which widely 
exist are most likely to be kept in transceiver designs because most energy related problems will 
have quadratic forms. Inspired by this fact, the framework proposed in this paper may work as 
the first shot which we can do for the coming wireless systems. We also want to highlight that 
although only transceiver design is investigated in our work, there exist several closely related 
research topics such as training design in channel estimation procedure [6] or signal reduction 
in sensor networks [|71. Taking signal reduction [7] as an example, it is exactly the forwarding 
matrix design for amplify-and-forward (AF) MIMO relaying systems |[8l. In addition it is well- 
known that training design and transceiver design have the same nature. Then it is not surprising 
that the solution proposed in this paper can also be applied to such kind of closely related topics. 
By the way, the main difference between this paper and its conference version [|9l is that the 
detailed explanations, justifications and discussions are given at various points of the paper. In 
addition, the important numerical simulations are given in this journal version. 

This paper is organized as follows. In Section |lll an interesting understanding of the transceiver 
designs from optimization theory is presented and it shows the evolvement of transceiver designs 
is just the same as the procedure to make the optimization problems more complicated. In 
Section |llll a concrete example of linear transceiver design is first given which shows the 
motivation for iterative algorithms. Meanwhile, the quadratic nature of LMMSE transceiver 
design is also revealed. How to exploit the quadratic nature is investigated in Section |IV] and 
the framework on QMP is discussed as well. In addition, the applications are specified. After 
that, an extension on robust designs is considered in Section |Vl The numerical results is finally 
presented in Section |Vll 

Notations: The following notations are used throughout this paper. Boldface lowercase letters 
denote vectors, while boldface uppercase letters denote matrices. The notations Z^, Z* and 
Z^ denote the transpose, conjugate and conjugate transpose of the matrix Z, respectively and 
Tr(Z) is the trace of the matrix Z. The symbol Im denotes an M x M identity matrix, while 
Om,n denotes an M x all zero matrix. The notation Z^/^ is the Hermitian square root of the 
positive semi-definite matrix Z, such that Z^/^Z^/^ = Z and Z^/^ is also a Hermitian matrix. The 
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symbol E denotes statistical expectation operation. The operation vec(Z) stacks the columns of 
the matrix Z into a single vector. The symbol ® represents Kronecker product. 

II. Motivations 

At the beginning, we would like to discuss why our attention is concentrated on linear 
minimum mean- square-error (LMMSE) transceiver designs in this paper. However for ceratin 
performance metrics such as bit error rate (BER) the performance of linear transceivers may be 
not as good as that of the nonlinear counterparts, linear transceivers are still preferred by practical 
wireless systems due to their low complexity. On the other hand, mean-square-error (MSE) is a 
widely used performance metric for estimation, detection and optimization algorithm designs in 
wireless systems. It should be pointed out that MSE acting as performance metric suffers from 
several inherent drawbacks as it is not the ultimate performance metric e.g., capacity and BER. 
Roughly speaking, MSE can be seen as an approximation of the ultimate performance metrics, 
although they have very close relationships and particularly in some special cases, they are even 
equivalent with each other. The tractability is the main advantage of MSE. For several ultimate 
performance metrics, their formulations may be too complicated to optimize. For engineers, the 
case where there is a solution is much better than that there is no solution. 

From the perspective of optimization theory, the LMMSE transceiver designs are in nature 
some specific optimization problems under different constraints. In general, there are two kinds 
of variables involved in the optimization problems, i.e., precoder/beamforming matrices and 
equalizer matrices. The main difference between them is that the equalizers are usually uncon- 
strained. While for precoder/beamforming, the story is different as there are always various kinds 
of constraints on the transmitters. 

The simplest MIMO communication system is the single user point-to-point MIMO system 
with only one power constraint. The signal model is y = HFs + n where y is the received signal 
at the receiver and H is the channel matrix between the transmitter and receiver. The symbol F 
denotes the precoder matrix at the source, s is the transmitted signal and n is the additive noise 
at the receiver. The corresponding LMMSE transceiver design problem is formulated as 

min /(G,F)=E{||Gy-s||2} 

s.t. Tr(FF^) < P (1) 
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where G is the equalizer matrix at the receiver and P represents the maximum transmit power 
at the transmitter. In the following, we try to understand transceiver designs for various wireless 
systems evolving from the previous one for the point-to-point MEMO systems. 

There are only two possible directions to make the transceiver design problem ([T) more 
complicated, i.e., enlarging the set of variables or enlarging the sect of constraints. When there are 
more than one constraint, these constraints can be homogeneous or not (have the same physical 
meaning or not). As previously discussed, the constraints are always related to transmitters. If the 
constraints are homogeneous, it means that there may exist many transmitters in the considered 
wireless system, such as multi-user MIMO (MU-MIMO) uplink. In this case the constraints 
are described as the second order term of the matrices variables is smaller than a threshold. Of 
course, the involved constraints can be inhomogeneous. For example, in the cognitive radio, there 
are usually two kinds of constraints. One is the power constraints and the other is interference 
constraints. In the latter one, the second order term of the matrices variables is also smaller 
than a threshold. Different from power constraints it describes that the caused interference in a 
certain direction must be lower than a threshold. In the following, we refer to the previous kind 
of constraints with second term smaller than a threshold as positive constraints. 

An interesting question is what about the constraint for which the quadratic term is larger than 
a threshold. It means in a certain direction the energy should be larger than a threshold. In a long 
time, there is no such kind of wireless systems. Recently, energy harvesting communications give 
a very important application of this case [[TOl . In an energy harvesting communication, except a 
traditional receiver, there also exists an energy harvesting receiver which aims at harvesting the 
energy emitted by the transmitter to charge its own battery. As a result, the transmitter should 
guarantee the energy harvested by the energy harvesting receiver is larger than a threshold. 
Similar to the case of cognitive radio, in the following we refer to this class of constraints with 
second term larger than a threshold as negative constraints. 

In conclusion, different mathematical formulations of the constraints represent different com- 
munication system setups. In the following, we list several concrete and representative examples 
to illustrate the relationships between various advanced wireless systems and the simplest point- 
to-point MIMO system. In particular, we want to show how to change of the optimization problem 
([U) to become the corresponding optimization problem for an advanced wireless system. 
Case 1: When only the number of unconstrained variables increases, it corresponds to MU- 
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MIMO downlink transceiver designs [[T4]| . [[T5l . In the following, /(•) represents the sum MSE 
function whose specific formulation is determined by the corresponding system model. The linear 
transceiver design for MU-MIMO downlink is given as follows 

min /([Gi,-- - ,G;,],F) 

s.t. Tr(FF^) < P (2) 

where F is the beamforming matrix at the base station, and is the equalizer matrix at the 
k!"^ mobile user. Additionally, P denotes the maximum transmit power at the base station. 
Case 2: When both the numbers of constrained variables and their corresponding constraints 
increase and the constraints are independent with each other, the result corresponds to MU- 
MIMO uplink transceiver designs jSl. In this case, the optimization problem is formulated as 

min /(G,[Fi,--- ,F,,]) 

s.t. Tr(FfcFf ) < Pfe (3) 

where F^ denotes the precoding matrix at the k^^ mobile user and the equalizer at the base 
station is denoted as G. In addition, Pk denotes the maximum transmit power at the k^^^ mobile 
use. 

Case 3: When both the numbers of constrained variables and unconstrained variables increase 
and the constraints are independent as well, this case corresponds to multi-cell transceiver designs 
ll26l . The beamforming design problem for multi-cell cooperation reads as 

min /([Gi,-- - ,Gx],[Fi,-- - ,Fk]) 

s.t. Tr(FfcF^) < Pfc, (4) 

where G^ is the equalizer at the k^^ base station and F^ is the precoder matrix at the k^^^ mobile 
terminal. Moreover, Pk is the maximum transmit power at the A;*^ mobile terminal. 
Case 4: Only increase the number of constraints and keep the set of variables unchanged. If 
the constraints are positive constraint, this case corresponds to cognitive radio (CR) transceiver 
designs. For CR, the transceiver design problem is formulated as 

min /(G,F) 

s.t. Tr(FF") < P 

Tr(H5FF«H«) < 7. (5) 
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where H5 is the channel matrix between the secondary user node and the primary user node 
and 7 denotes the allowable interference threshold. 

Case 5: In contrast to Case 4, when only increasing negative constraints, it corresponds to energy 
harvesting oriented transceiver designs. The energy harvesting beamforming design is given as 

min /(G,F) 

s.t. Tr(FF") < P 

Tr(HpFF«Hi) > 7, (6) 

where Hp denotes the channel between the source node and the energy harvesting node. The 
physical meaning of the second constraint is in the information transmission, the source node 
wants to charge the energy harvesting node as well. It should be pointed out that the main 
difference between Cases 4 and 5 is that the increased constraint is negative or positive. 
Case 6: When both the number of the constrained variables and the number of corresponding 
number of constraints increase and meanwhile the constraints are coupled, this case corresponds 
to the amplify-and-forward (AF) MIMO relaying transceiver designs [[TtI . The transceiver design 
for two-hop AF MIMO relaying systems can be formulated as 

min /(G,[Fi,F2]) 
s.t. Tr(FiFf ) < Pi 

Tr(F2(HiFiFf + <I)Ff ) < P^ (7) 

where Fi is the source precoder at the source node and F2 is the forwarding matrix at the relay. 
Furthermore, Hi is the channel matrix between the source node and the relay node. In addition 
Pi and P2 are the maximum transmit power at the source and relay, separately. Notice that the 
matrix cr^^I is the noise covariance matrix at the relay and HiFiF^H^ + a^^I is the received 
signal correlation matrix at the relay. It is obvious that the two constraints are coupled with each 
other. Inspired by the formulation, for a more general multi-hop model, the transceiver design 



March 5, 2013 



DRAFT 



9 



problem becomes 



mm 



/(G, [Fi,-- - ,Fx]) 



s.t. Tr(FiFf ) < Pi 

Tr(F,Rfc_iFiJ) < Pfc 



2<k< K 



-1 — 



Hfc_iFfc_iRfc 



,2Ft,Hf_, + <_^I 2<k<K 



Ro 



I 



(8) 



where F^ is the forwarding matrix at the k node, Pk is the corresponding maximum transmit 
power and H^^^ is the k^^ hop channel matrix. The matrix cr^ij._^I is the covariance matrix of the 
additive noise at the (k — l)*"^' relay and R^-i is the received signal correlation matrix at the 
{k - If^ relay . 

From Case 1 to Case 6, it can be concluded that the evolvement of wireless communication 
systems is exactly the evolvement of optimization problem becoming complicated. Of course, the 
story can continue and we will have Case 7, Case 8 and so on. For engineers, physical meaning is 
more important than mathematics itself. However, as engineering problems must be perceptible 
in mathematics here based on these examples we can say that physical meanings cannot be 
independent of mathematics which can help us to predict what the future communication systems 
would like to be. 

In the following, we will show in detail that for the above optimization problems when iterative 
algorithms are used, the considered optimization problem admits quadratic nature. As a result, 
the quadratic matrix programming technology can be used. 



In this section, the quadratic nature of the aforementioned optimization problems is investi- 
gated. It is totally redundant to discuss it case by case. For simplicity we take a representative 
example to illustrate that quadratic matrix programming (QMP) problems are of great importance 
in LMMSE transceiver designs. Note that this example has been discussed in detail in our 
previous work [[T6l . Here, it only provides a prologue of our work in this paper. First, we want 
to highlight that the algorithm discussed in the following is not limited to this example, which has 
a much wider application range. We aim at providing a comprehensive framework on LMMSE 



III. Quadratic Nature of the Transceiver Designs 
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transceiver design. Our discussions are not limited to any specific communication system. We try 
to reveal the nature of LMMSE transceiver designs and answer the questions why QMP should 
always be chosen and how to solve the transceiver design optimization problems using QMP. 

A. An example: 

The considered example is a mixture of Case 3 and Case 6. Here, a dual-hop AF relaying 
network is investigated. As shown in Fig. [H there are multiple source nodes, relay nodes and 
destination nodes. Furthermore, different sources can have different numbers of transmit antennas 
and data streams to transmit. It is denoted that the number of transmit antennas of the i^^ source 
is Ns^i- It is also assumed that for each source node there may be more than one corresponding 
destination node. There are also multiple relay nodes in the network, and the j*'^ relay has M fjj 
receive antennas and Njij transmit antennas. At the first hop, the source nodes transmit data to 
the relay nodes. The received signal Xj at the j^^ relay node is 



where is the data vector transmitted by the i source node to the k destination with the 
covariance matrix Rs,^. = EjsjfcS^}. When the i**^ source node does not want to transmit signal 
to the k^^ destination, Sj^ is a all-zero vector. 

At the source, before transmission the signal is multiplied a precoder Ptk under al transmit 
power constraint Tr(PjfcRs.j.P^) < Ps,i, where Ps,i is the maximum transmit power at the 
i^^ source node. The matrix tlsr,ij is the MIMO channel matrix between the i^^ source node 
and the j*'^' relay node. Symbol ni is the additive Gaussian noise with the covariance matrix 
J . At the j"^ relay node, the received signal Xj is multiplied by a precoder matrix Fj, under a 
power constraint Tr(FjRxT^) < Prj where Rx^ = E{xjX^} and Prj is the maximum transmit 
power. Then the resulting signal is transmitted to the destination. The received signal at the k^^ 
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destination can be written as 

Yfc = / , (HrdjfcFjXj) + n2,i 
^ — '3 

= .[HrrfjfcFjV^ (Hsr,«jPifcS;fc)] 

+ ^ XHrrfjfcFjnij) + n2,fc. (10) 

where Hj.(i is the MIMO channel matrix between the j**^ relay and the /c*^ destination, and 
W2,k is the additive Gaussian noise vector at the k^"^ destination with covariance matrix . 

The optimization problem of linear minimum mean-square-error (LMMSE) transceiver design 
can be formulated as [fT6l 

min J]^MSEfc = E{||Gfcyfc-[s^„-- - ,s^^,r||2} 

s.t. Tr(F,R,Tf ) < P,,,- je£, 

5^ Jr(Pa.Rs.,Pffc) < P.. ^e^. (11) 

where [s^^, ■ ■ ■ , ;,]^ is the desired signal to be recovered at the k^"^ destination. Additionally 
Er and Eg denote the set of relay nodes and the set of source nodes, respectively. 

The optimization problem (fTTI) is a very general problem which includes the following sce- 
narios as its special cases. 

• Multi-user MIMO uplink transceiver design [fTTI : Multiple multi-antenna mobile users com- 
municate with a multi-antenna base station. 

• Multi-user MIMO downlink transceiver design [fTTI : A multi-antenna base station communi- 
cates with multiple multi-antenna mobile users. 

• Multi-cell coordinated beamforming design: Multiple multi-antenna base stations communicate 
cooperatively with multiple multi-antenna mobile users. 

• Two-way AF MIMO relaying LMMSE transceiver design [fTSlI : Two-way AF MIMO relaying 
can be taken as a soft combination of uplink and downlink beamforming designs. Although, 
the optimization problem (fTTT) only considers one-way relaying systems. The extension from 
one-way to two-way is straightforward when an iterative optimization framework is used. 
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B. Iterative Algorithms 

As in the optimization (fTTI) there are too many variables to be optimized and meanwhile the 
nonconvex nature of the optimization problem (fTTTl makes it very complicated, generally it is 
difficult to find the closed-form globally optimal solutions. In order to design the transceivers, 
several suboptimal solutions are usually proposed. Iterative algorithm is one of the most widely 
used and important suboptimal solutions. In an iterative algorithm, the variables are optimized 
sequentially. It can be interpreted that iterative algorithms use iterative procedure to soften 
the hardness of the original optimization problems as in the iterative procedure the coupling 
relationships among the involved variables can be removed first. 

We admit that iterative algorithms suffer from some well-known weaknesses. First, the final 
solution is greatly affected by the initial value selection. Second, the convergence of an iterative 
algorithm must be guaranteed. If not, the algorithm may be meaningless. Third, in general 
even with proved convergence there is no guarantee that the final solution is globally optimal. 
However, iterative algorithms still have two important characteristics making them preferable. 
First, it can be applied to a much wide area of transceiver designs ranging from a point-to- 
point system to a distributed network. Second, it can act as a performance benchmark for other 
suboptimal solutions. Actually iterative algorithms are widely adopted in transceiver designs or 
beamforming designs for MIMO systems no matter you love it or hate it [|T3l|. When iterative 
algorithms are adopted to solve the optimization problem (fTTI) . in each iteration one variable is 
optimized and the others are fixed, and then the problem admits quadratic nature. 

C. Quadratic nature of the LMMSE transceiver designs 

Data detection MSE is an integration over the signals and noises. From its name, it is obvious 
that MSE is a certain quadratic formulation with respect to each involved variable. Moreover, 
in this paper, we concentrate our attention to the case where the variables are matrices, as in 
MIMO systems the variables to be optimized are usually complex matrices. Inspired by these 
facts, to characterize a quadratic function with a complex matrix variable a kind of functions 
termed as quadratic matrix (QM) functions X is first defined as 

fi{X) = Tr(D;X«AzX) + 27^{Tr(B«X)} + q (12) 
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where A; = e C"^", e C"^^ q G M, D; = G In addition, 7^{•} denotes the 

real part. It can be seen that a QM function consists of three terms which are second-order term, 
first-order term and zero-order term. If the following conditions are satisfied, not matter what 
the system is, the MSE with linear transceivers is a QM function with respect to each variable, 
separately. 

(1) . The considered system is a linear system. Linearity is defined based on the following two 
properties: 

(a.l) The received signal at the destination is a linear function of the transmit signal when all 
design variables are fixed. 

(a.2) The received signal at the destination is a linear function with respect to each variable 
when the signal and the other design variables are all fixed. 

(2) . The desired signals are independent of the noises. It means that when the transmit signal 
vector is denoted by s and the equivalent noise vector is v, the following equality must hold 



Moreover, the constraints in the transceiver designs for wireless systems are usually QM 
functions as well. This is because the involved constraints are usually related with energy, which 
definitely have quadratic terms e.g., transmit power, interference to primary users, and so on. 
Therefore, it is of great importance to investigate the optimization problems consisting of QM 
functions in both objective function and constraint functions. This kind of optimization problems 
is named as quadratic matrix programming (QMP) problems. It can be observed that in each 
iteration, the optimization problem (fTTT) becomes a QMP problem. Although in lfT9l . a definition 
of quadratic matrix programming is given, in this paper we first revise the definition given in 
|fT9l in order to accommodate more cases e.g., the problem (fTTI) . As a result, our definition is 
more general and has a wider range of applications. A standard QMP problem is defined as 



E{sv"} = 0. 



(13) 



Type 1 QMP: 



mm 

X 



Tr(DoX^AoX) + 27e{Tr(B^X)} + cq 



s.t. 



Tr(DiX"A,X) + 27^{Tr(Bf X)} + q < 0, z G X 
Tr(DjX^A,X) + 27^{Tr(BfX)} + cj = 0,j eS 



mxr 



(14) 
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where Ai = Af e C"^'^, e C"^^ q e M, D; = Df g / e {0} U X U ^. These 

assumptions are essential to guarantee that the objective function and constraint functions are 
real-valued functions, as it is meaningless to minimize a complex-valued function. The main 
difference between our definition and that given in [|T9l is that in [[T9l = I while in our 
definition they can be arbitrary Hermitian matrices. In the following section, the important 
characteristics of QMP problems will be discussed, based on which a comprehensive framework 
on how to solve it is also given. In the sequel the Type 1 QMP problems are abbreviated to be 
T-l-QMP problems. 

IV. Fundamentals of QMP 

In this section, the fundamental properties of QMP are investigated. It is obvious that quadratic 
matrix programming (QMP) is a special case of quadratically constrained quadratic programming 
(QCQP) which is a very famous and widely used ll23l . Obviously the QMP problems have 
much better properties (e.g., Kronecker structure) than traditional QCQP problems, which can 
be further exploited to solve the considered optimization problems more efficiently. This is 
exactly the motivation of the research on QMP ffT9l . [|20l . We embark on our investigation from 
the T-l-QMP problems in (fT4)) . which are the most general problems. 
General QMP: 

Based on the properties of Kronecker product and the following definitions 

O A; vec(Bi) 
vec«(BO Q 
the optimization problem (fT4] | is equivalent to 



^1 = 



/g{0}UXU^ (15) 



min Tr(rioZ) 

s.t. Tr(riiZ) < 0, TV(rjjZ) = 

Z = [vec'^(X) l]^[vec^(X) 1]. (16) 

If the constraint Rank(Z) = 1 is relaxed (it is a well-known semi-definite relaxation (SDR) ll20l ). 
we have the following semi-definite programming (SDP) problem [|22ll . which can be efficiently 
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solved by interior point polynomial algorithms 



mm 
z 



Tr(l^oZ) 



s.t. 



Tr(riiZ) < 0, Tr(rjjZ) = 



[Z]ArAr,+i,ArAr^+l 



1, Z ^ 



(17) 



where Z is a Hermitian matrix. 

Applications: Generally speaking, for iterative LMMSE transceiver designs for the previously 
considered systems in each iteration the variables can always be solved using the solution for 
the general QMP problem, e.g, multi-cell transceiver designs, CR transceiver designs, energy 
harvesting transceiver designs, AF MIMO relaying transceiver designs and so on. 
Convex QMP: When A; and are both positive semi-definite matrices and the involved 
constraints are only inequality constraints, the QMP problem (fT4)) is convex [[2T|. Convexity may 
be the most favorable property for an optimization problem and convex optimization problems 
can usually be efficiently solved. In the sequel, it is revealed that for convex QMP problems, 
it does not need the previous SDR to compute the optimal solutions. In the following, two 
approaches to solving convex QMP problems are proposed. 
SDP Based Algorithm: 

Using the properties of Kronecker product Ti{AB) = vec^(A^)vec(S), the QM function 
can be reformulated as 



based on which and together with Schur complement lemma, the optimization problem (fT4l) can 



Tr(Df X^AiXDf ) + 27^{Tr(BfX)} + q 
= Tr(Df X^Af Af XDf ) + 27e{Tr(B[^X)} + q 



= vec^(X)(Df (g) A,2 )(Df ® Af )vec(X) 
+ 27e{vec"(Bz)vec(X)} + q < 0, 



H T 1 



(18) 
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be reformulated as 



mm 



s.t. 



[Do^ ® A|)vec(X) 



((Do' ® A|)vec(X))^i -27^(vecH(Bo)vec(X)) + t 



fD/ ® AhvecfX) 



^ 



^ 0. 



(19) 



((D/ ® Af )vec(X))" -27^(vec"(Bi)vec(X)) - q 
Notice that in our work, the variables are complex matrices. For some optimization toolboxes, 
maybe only real variables are permitted. In that case, only a minor transformation is needed, 
which is 



In V 



a 



y- 



hN V 

~T 

V a 



y 



where v is defined as 



V = [Real(v)"^ Imag(v 



,TiT 



(20) 



(21) 



Furthermore, if Aj and Dj are both positive definite matrices (stronger than positive semidef- 
inite matrices), the optimization problem can be further transformed into a more efficiently 
solvable convex optimization problem e.g., second order conic programming (SOCP) problems. 
SOCP Based Algorithm; 

Notice that when A^ and Dj are both positive definite, the QM functions in both the objective 
function and constraints can be reformulated as 

Tr(Df/^X"A,XD,^/^) + 27^{Tr(Bf X)} + q 



+ Ci 



AfXDf +A, ^B,D, ^ 

- Tr(Ar^BzDr^Bf ) (22) 

where || • ||f denotes Frobenious norm. Therefore, the optimization problem (fT4l) can be refor- 
mulated as a standard SOCP problem which reads as 



min t 

Pfe,i 



S.t. 



A|XD| 



Ao'BoDo^ 



A. ^B,-D, ^ 



< t 



< A/Tr(AriB,D7^B«l 



(23) 
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Applications: Convex-QMP is suitable for multi-cell transceiver designs and AF MIMO relaying 
transceiver designs. 

Based on the previous discussions it can be concluded that the better structure the stronger 
solution. In the remaining part of this section, we will take a further step to concentrate our 
attention to the QMP problems which have the following special structure 

Type 2 QMP: 

min Tr(X^AoX) + 27^{Tr(B^X)} + co 

s.t. Tr(X^AiX) + 27^{Tr(Bf X)} + q < 0, i G X 

Tr(X"AjX) + 27^{Tr(Bf X)} + 9 = 0,j eS 

X G C"^". (24) 

The Type 2 QMP problems are also usually encountered in the LMMSE transceiver designs for 
wireless communications [|27l . It is worth investigating its properties detailedly. For the notational 
simplicity, in the following the T-2-QMP problems are referred to as the Type 2 QMP problems. 

A. Properties of T-2-QMP 

1) T-2-QMP without Constraints: At the first glance, we discuss the case without constraint 
which reads as 

min Tr(X^AoX) + 27^{Tr(B[^X)} + co (25) 

where Aq > 0. This case corresponds to linear minimum mean square error (LMMSE) equalizer 
design, which is also named as LMMSE estimator design. In this case, as previously discussed, 
the optimization problem is convex and the optimal solution is exactly the solution making the 
differentiation of the objective equation equal i.e., AqX = — Bq. Specifically, the optimal 
solution has the following closed-form solution 

Xopt = -Aq ^Bo. (26) 

This solution is a very strong solution, which is also the optimal solution of weighted MSE 
minimization problem independent of weighting matrices. 



March 5, 2013 



DRAFT 



18 



Weighted MSE is a direct generalization of sum MSE. Considering weighted MSE minimiza- 
tion, the optimization problem becomes to be 

min T^(W„X^AoX) + 27^{Tr(W^BJ;'X)} + co (27) 

where W„ ^ is the weighting matrix. Following the same logic as previously discussed, the 
optimal solutions must satisfy 

AoXWw = -BoW„. (28) 

Actually, this condition is a sufficient condition for the optimal solution as the optimization 
problem is convex. Because W„ can be ill-rank, the optimal solution is not unique. Notice that 
the following solution satisfying the previous condition (|28l) 

Xopt = -Ao ^Bo. (29) 

This conclusion is important as it shows that Xopt is a dominating estimator. It is why even for 
capacity achieving transceiver designs, LMMSE equalizer is optimal. 

Conclusion 1; Without constraints, the optimal solution Xopt of the T-2-QMP problems has a 
closed form. Notice that X^p^ is just the Wiener filter. It is well-known for a linear system with 
Gaussian noise, LMMSE equalizer is exactly the optimal equalizer in the sense of both linear 
equalizers and nonlinear equalizers [|25l . To the best of our knowledge, this solution can be 
applied to all linear equalizer designs in wireless systems. 

2) T-2-QMP with One Constraint: After discussing the case without constraints, we take a 
step further to focus on the case where there is only one constraint for the considered QMP 
problem. This case corresponds to the scenario when there is only one transmit power constraint. 
Here we focus on the following T-2-QMP problem 

min Tr(X^AoX) + 27^{Tr(B[?X)} + co 

s.t. Tr(X^AiX) < P, (30) 

where A/ > 0. For the problem we considered, the feasible set is not empty. In this scenario, 
solving the matrix variable can be reduced to solve an unknown scalar variable. The computa- 
tional dimensionality and complexity are both significantly reduced. In this following, we will 
discuss this in detail. 
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For constrained optimization problems, if certain regularity conditions are satisfied, Karush- 
Kuhn-Tucker (KKT) are the necessary conditions for the optimal solutions and then KKT 
conditions can provide very important information to help us find the optimal solutions. When 
there is one constraint, linear independence of constraint qualification (LICQ) can be easily 
proved, which is a famous regularity condition ifTTI . [fT2l . In this case, the condition for LICQ 
to hold is that the optimal solution X is not all zero matrix. In practical wireless systems, this is 
always true as when transmitter matrix is all zero, there is no information to be transmitted and 
of course it is not the optimal solution. Therefore, KKT conditions are the necessary conditions 
for the optimal solutions [El, [fT2l. 

The corresponding Lagrange function of the optimization problem (l30l) is expressed as 

C(X) = Tr(X«AoX) + 27^{Tr(B^X)} + cq 

+ /i(Tr(X«AiX)-P), (31) 



where /i > is the Lagrange multiplier. Based on (1311 ). the KKT conditions of the optimization 
problem (|30l) can be directly derived to be [|2T| 

(Ao + Mi)X = -Bo (32) 

/i(Tr(X"AiX) - P) = (33) 

Tr(X"AiX) < P (34) 

/i > 0. (35) 

In this case with a single constraint, the optimal solution has the following semi-closed-form 
solution 

X = -(Ao + /iAi)-^Bo (36) 

in which the only unknown variable is a scalar Lagrange multiplier. Substituting (|36] ) into the 
constraint of (|30l ). we have 

Tr(X^AiX) 
=Tr(B«(Ao + AiAi)-iAi(Ao + /iAO"'Bo) 
=Tr(B«A^^(A^UoA^^ +/iI)-2A^^Bo) 

(37) 



March 5, 2013 



DRAFT 



20 



It has been proved that g{fi) is a decreasing function with respect to |[26ll . and the value of /i 
satisfying the KKT conditions can be found by using a simple one-dimensional search such as 
bisection search. Based on this conclusion and the KKT conditions given previously, the value 
of /i can be computed to be 



It can be seen that the solution satisfying KKT conditions is unique. As the KKT conditions 
are the necessary conditions for the optimal solutions. As a result, the unique solution satisfying 
the KKT conditions is exactly the optimal solution. This is of great importance. In this case, the 
unknown variable is simplified from a matrix to a scalar. In other words, the number of variables 
is significantly reduced and the corresponding computational complexity will be significantly 
reduced. 

Conclusion 2; With only one constraint, the T-2-QMP problem has a semi-closed-form solution 
with an unknown scalar variable. This solution is applicable to downlink MU-MIMO beamform- 
ing design at the base station and amplifying matrix design for the dual-hop AF MEMO relaying 
transceiver designs (including both one-way and two-way). 

Remark: We cannot argue that KKT conditions are necessary conditions for the optimal solu- 
tions without any prior conditions. In Boyd's classical textbook [|2T1l . it never states that KKT 
conditions are necessary optimality conditions for any optimization problems. There are several 
cases in which KKT conditions are not necessary optimality conditions [|TT]|. 

3) T-2-QMP with more than one constraint: For T-2-QMP problems with more than one 
constraint, solving the optimization problems must also rely on interior point algorithms. As a T- 
2-QMP problem has much better structures comparing to a general QMP problem discussed in the 
previous section, it exhibits more stronger convexity property which can be exploited to solve the 
optimization problem. As discussed in [|20l . the original optimization problem is first transformed 
into its homogenized problem which can be efficiently solved. First, the homogenized QM 
function of the QM function defined previously is denoted by 




Solve g{ii) = P Otherwise 




(38) 



/,"(Y; Z) =Tr(Y"A,Y) + 27^{Tr(Z"Bf Y)} 
-I- -Tr(ZHZ). 



(39) 



r 
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Then introducing the following operators, 



Miifi) 



(40) 



the homogenized optimization problem of (|24)) is formulated as 



min Tr(M(/o)[Y;Z][Y;Z] 



H 



s.t. Tr(M(/,)[Y;Z][Y;Z]«)<a„z 



Tr(M(/,)[Y;Z][Y;Z: 



I 



Y eC 



mxr 



(41) 



■r 



Notice that the optimal solution of ^ Xopt equals Xopt = YoptZ^p^. Defining U = [Y; Z] [Y; Z]^, 
after relaxing the rank constraint on U, we have the following optimization problem 

min Tr(M(/o)U) 

s.t. Tr(M(/,)U) <«„^eX 

Tr(M(/,)U)=a„jG£: 



To recover X from U, an algorithm based on rank reduction has been discussed in detail in [19]. 
When the number of the constraints are less than 2r, this relaxation is tight Il20l . Comparing (|42] | 
with (fT9l) . it can be observed that the SDP problem for T-2-QMP problems has a much lower 
dimension than that for T-l-QMP. It is because the T-2-QMP problems have a better structure to 
be exploited. In other words, it can be concluded that T-2-QMP problems have much stronger 
convexity than T-l-QMP problems. 

Applications: The solution of the T-2-QMP problem can be applied to AF MIMO relaying 
transceiver design at the source node with cognitive radio interference constraints. 

B. Discussions 

As mentioned at the beginning of this section, QMP is a special case of quadratically con- 
strained quadratic programming (QCQP) discussed in [|23l , it is important to compare the QMP- 
based algorithms with the QCQP-based algorithms given in ll23l . Due to the fact that QMP 




(42) 
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is a special case of QCQP, QMP problems have better structures and enjoy better properties. 
For example, for the general T-2-QMP problems, they have stronger duality in semidefinite 
relaxation than the QCQP problems discussed in [|23l . Particularly, for the case when there is 
only one constraint, using the QMP-based algorithm, the optimal solution can be computed 
by using a bisection search instead of solving a SDP problem. On the other hand, solving T-2- 
QMP problems, QMP-based algorithms have a much smaller dimension QCQP-based algorithms. 
Based on the complexity analysis in [[22|. if the matrix variable X is an M x M matrix, for T-2- 
QMP problems using QMP-based algorithm in (|42|) the complexity is 0{M^-Hn{l/e)) where e is 
the precision. While using the QCQP-based algorithm in [|23l the complexity is C(M^ln(l/e)). 
It can be seen that the QMP-based algorithms have a great advantage in terms of computational 
complexity. 

In addition, it is also very interesting to compare the QMP-based algorithms with the brute 
force iterative algorithms in which matrix variables are just taken as multi-dimensional vector 
variables and then brute force algorithms such as neural network algorithms are used to compute 
them. The main advantage of the QMP-based algorithms is that for QMP-based algorithms some 
nature of the optimization problems is revealed and this is the reason why in certain cases even 
with a constraint, the solution has a semi-closed-form solution. For the general cases, the QMP- 
based algorithms can exploit the problem structure to improve the precision of the final solution 
and accelerate the convergence speed of the algorithm. 

V. Robust Transceiver Designs Based on QMP 

From the practical viewpoint, due to the limited length of training sequences and time varying 
nature of wireless channels, channel estimation errors are always inevitable. Channel errors will 
significantly decreases system performance. It is well-established that robust transceiver designs 
or beamforming designs can mitigate this negative effects [|26l . [|27l . A question naturally arises 
that whether the previously discussed QMP-based algorithms can be applied to so-called robust 
transceiver designs. This is exactly the focus of this section. 

When channel errors are considered, the channel state information can be written as [|27l 

Hi = + AUi (43) 
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where is the estimated H/ and AH; is the corresponding channel estimation error, respectively. 
The kronecker correlation model is widely used for channel estimation errors [|26l . [|27l 

AHi = ^fHwM- (44) 

where and are the row and column correlation matrices, respectively. The inner matrix 
iiw,i is a random matrix with i.i.d Gaussian random elements with zero mean and unit variance. 
Take the simplest point-to-point MIMO system as example to illustrate the impact of random 
matrix integrations. For the point-to-point MIMO system, the data MSB at the destination equals 
to 

E{Tr(GHFF^H^G") - 27^{Tr(GHF)} + a,^^Tr(GG")} (45) 

where the expectation operation at the outside is due to channel estimation errors. This equation 
is a QM function with respect to F or G. As a QM function consists of zero order term, first 
order term and second order term of the variables, in the following the matrix integrations over 
them are discussed separately. Zero-term is a constant and it is obvious that its integration with 
respect to any variable is itself. 

Notice that the channel estimation errors are independent of the signal and the noise and their 
means are all zero. Based on these facts we directly have the following result for the first order 
term 

E{H;X} = (46) 

The integration over the second order term is a little bit complicated. In order to make it clear, 
a preliminary result on complex matrix integration is given first. 

Complex matrix integration: For two M x N random complex matrices Q and W, if they 
satisfy 

E{vec(Q)vec^(W)} = A ® B, (47) 

the following equality holds 

S = E{QRW^} = BTr(RA^) (48) 

Proof: See Appendix A. ■ 
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Based on the Kronecker product model (|44l) and the preliminary result we have the following 
equation 

E{H,XX^Hf } = HjXX^Hf + Tr(XX"*z)Si. (49) 

It is obvious that the expectation of a second-order term is also a second-order term. The main 
difference compared to the perfect case is that there is a residual part Tr(XX^^';)Si caused by 
channel error. Based on the results on the expectation on the zero term, first order term and the 
second order term we have the following conclusion. 

Conclusion 3: For LMMSE transceiver designs, expectations of channel estimation errors keep 
the quadratic nature of the original QMP problems. Then it is not surprising that QMP technology 
can also be used in robust transceiver designs. 

Remark: In the reference [l24l. only the matrix operations for real matrix variates are presented. 
Strictly speaking, it is not rigorous to directly use the results in that book [|24ll or simply replace 
the symbol T by the symbol H in the involved matrix operations. Here for completeness we 
give a detailed proof about complex matrix integrations to make sure our results are rigorous. 

VI. Numerical Results 

In this simulation part, in order to assess the effectiveness of the proposed solution, two 
different examples are shown. In the first example, there are two pairs of source and destination. 
Moreover, there are two relays facilitating the communications between the sources and their 
corresponding destinations. The direct links between the sources and destinations are neglected 
due to deep fading. In Example 1, the source nodes only transmit signals and the destination 
nodes only receive signals. In the second example, there are two sources to exchange information 
assisted by two relays. In order to improve the spectral efficiency, the famous physical layer 
network coding strategy named two-way relaying is adopted. Specifically, in the first time slot, 
two source terminals send their information to the relays and then the relays broadcast the filtered 
received signals to the two terminals. After that each terminal removes its own transmitted signal 
in the first time slot first and then recovers its desired signal. 

In both the two examples, all nodes are equipped with multiple antennas. At each source 
node, two independent data streams, each with 10000 independent quadrature phase-shift keying 
(QPSK) symbols, are transmitted. Each point in the following figures is an average over 500 
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independent channel realizations. Furthermore, the famous Matlab toolbox CVX [|28l is used in 
this paper to solve the standard convex optimization problems. 
Example 1: 

In Example 1 for simplicity all nodes are equipped with Nt antennas. In the first hop, the 
noise covariance matrices at the two relays are defined as Rn^ ^ and Rm 2^ respectively. Without 
loss of generality, it is assumed that 11^ i = Rm 2 = ^ni^Nf Similarly, in the second hop, the 
noise covariance matrices at different destination are defined as Rna 1 = R-n2 2 = '^n2^Nf The 
signal-to-noise ratios (SNRs) for the source-relay links are defined to be Esr,k = Ps,k/Nta'^_^ 
, and are fixed to be E^^ ^ = 20dB. The SNR for each relay-destination link is defined as 

For iterative algorithms, there is a well-known criterion for the initial points selection. It 
states that the initial value should be close to the optimal solution. However, this criterion seems 
meaningless as the optimal solution is usually unknown. Fig. [2] shows the total data detection 
MSEs of the proposed algorithm with different initial precoder matrices at the source and relay 
when Nt = 4. In our simulation settings, three kinds of initial values are selected to make a 
comparison, i.e., full rank identity matrix with the power constraints satisfied, full rank identity 
matrix without the constraints satisfied, diagonal matrices with rank of 3 and satisfying the power 
constraints. It can be observed that the initial values being full rank are much better than that 
with lower rank. The reason is full rank initial values can provide a larger available set for the 
following optimal value search than the lower rank initial values. Furthermore, for the full rank 
initial values, the one satisfying constraints is better than that without satisfying constraints. As 
for most of practical transceiver designs, the optimal solutions always occur on the boundary of 
the constraints. As a result the initial values satisfying constraints seem to be much closer than 
those without satisfying constraints and then they have better performance. 

Fig. [3] shows the performance advantage of the proposed algorithm over the simplest uniform 
power allocation scheme in terms of averaged MSE in the two different cases Nt = 2 and 
Nt = 4. In uniform power allocation algorithm, the precoder matrices at the sources and relay 
are proportional to the identity matrices which are scaled by factors to make the equalities in 
the power constraints. In conclusion we can say that the proposed iterative algorithm can act as 
a better benchmark algorithm compared with the naive uniform power allocation scheme. 
Example 2: 
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In Example 2, the sources equipped with two antennas, i.e., Ng = 2. The two relays are 
equipped with antennas. The noise covariance matrices at the relays are set as Rn^i = 
R-n,. 2 = '^ur^Nr- Similarly at the sources, the noise covariance matrices are Rn^, i = Rns2 = 
a'^l^^. Then in the first time slot SNRs for the source-relay links in the first slot are defined 
as Esf,,fc = Ps,k/Ns<j'^^ and fixed to be 20dB. In the second time slot, the SNR for each relay- 
destination link is defined as Ef,s,fc = Pr,k/NrCrl^, and without loss of generality, it is assumed 

that ErsA = Ers,2 = E^s- 

The total MSEs of the proposed algorithm with different initial precoder matrices at the relays 
with Nj. = 8 are shown in Fig. |4l A similar result to Example 1 is achieved. In the two-way 
relaying network, the full rank initial value satisfying the constraints leads to the best performance 
and the ill-rank initial value with rank being 6 is the worst one. 

In Fig. [5l we compare the total MSEs of the uniform power allocation strategy and proposed 
algorithm in cases of Nr = 4: and Nr = 8. It is shown that for the two-way relaying network, 
the proposed iterative algorithm also performs much better than the uniform power allocation 
strategy. By the way as the number of antennas at the relay increases, the performance advantage 
of the proposed algorithm becomes larger. Both Examples 1 and 2 have demonstrated the 
effectiveness of our proposed iterative algorithm and verified the correctness of our theoretical 
analysis. 

VII. Conclusions 

In this paper, we discussed a unified iterative linear transceiver design with MSE as the 
performance criterion for different wireless systems. Different from the previous existing work, 
in our work the transceiver designs were understood from a unified optimization problem named 
as QMP problems for various wireless systems. The QMP-based designs can be applied to 
multi-cell coordinated beamforming designs, multi-user MIMO beamforming designs, cognitive 
radio MIMO beamforming designs, beamforming designs for cooperative networks and their 
robust designs with Gaussian random distributed channel estimation errors with row and column 
correlations. Along with transceiver designs, the elegant properties of QMP problems were also 
discussed in detail. In addition a framework on how to solve QMP problems was also given. The 
work presented in this paper will act as a baseline algorithm for the future wireless transceiver 
designs. 
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Appendix A 
Complex Matrix Integration 

For the expectation of the following product 

S = E{QRW"} (50) 

where Q and W are two M x N random matrices with compatible dimension to R, the {i,jy^ 
element of S is 

[E],, =E{[Q],,R[W]J} 

= 5^5^E{[Q],,[R],,[W]*J. (51) 

t k 

If the two random matrices Q and W satisfy 

E{vec(Q)vec^(W)} = A ® B, (52) 

where A is a A^x matrix while B is a MxM matrix, then we have the equality E{[Q]i^ [^]i2,i2} 
[B]j^^j2 [A]ii,j2- [Q]j,t \^]j,k are scalars, (ISTT ) can be further written as 



t k 
t k 

Finally, writing (|53T ) back to matrix form, we have [|25l 

S = BTr(RA'^). (54) 

Notice that this conclusion is independent of the matrix variate distributions of Q and W, but 
only determined by their second order moments. 
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Fig. 1. A distributed AF MIMO relaying network. 
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Fig. 2. Averaged MSE performance of the proposed algorithm with different initial values in Example 1. 
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Fig. 3. Comparisons between the proposed algorithm and the unifoim power allocation scheme in Example 1. 
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Fig. 4. Averaged MSE perfomance of the proposed algorithm with different initial values in Example 2. 




Fig. 5. Comparisons between the proposed algorithm and the uniform power allocation scheme in Example 2. 
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